Papers with Spoken dialogue systems
Code-switched inspired losses for spoken dialog representations (2021.emnlp-main)
Copied to clipboard
| Challenge: | We introduce new pretraining losses tailored to learn generic multilingual spoken dialogue representations . goal is to expose model to code-switched language . |
| Approach: | They propose to build a pretraining corpus of multilingual conversations in five different languages from OpenSubtitles. |
| Outcome: | The proposed models perform better in monolingual and multilingual settings. |
Think, Verbalize, then Speak: Bridging Complex Thoughts and Comprehensible Speech (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to decouple LLMs from spoken communication produce suboptimal results due to mismatches between optimal textual and verbal delivery. |
| Approach: | They propose a framework that decouples reasoning from spoken delivery to preserve the full reasoning capacity of LLMs. |
| Outcome: | The proposed framework preserves full reasoning capacity of large language models . it improves speech naturalness and conciseness with minimal impact on reasoning . |
Speculative End-Turn Detector for Efficient Speech Chatbot Assistant (2026.acl-long)
Copied to clipboard
| Challenge: | Spoken dialogue systems with large language models struggle with end-turn detection . this limitation often leads to premature or delayed responses, disrupting the flow of spoken conversations. |
| Approach: | They propose a dataset for end-turn detection that uses a lightweight GRU-based model and a high-performance Wav2vec-based system to make a more challenging classification of distinguishing turn ends from mere pauses. |
| Outcome: | The proposed framework significantly improves real-time ETD accuracy while keeping computations low. |